Convergence of Gibbs Sampling: Coordinate Hit-and-Run Mixes Fast
نویسندگان
چکیده
Gibbs sampling, also known as Coordinate Hit-and-Run (CHAR), is a Markov chain Monte Carlo algorithm for sampling from high-dimensional distributions. In each step, the selects random coordinate and re-samples that distribution induced by fixing all other coordinates. While this has become widely used over past half-century, guarantees of efficient convergence have been elusive. We show convex body K in $${\mathbb {R}}^n$$ mixes $$O^{*}(n^9 R^2/r^2)$$ steps, where contains ball radius r R average distance point its centroid. give an upper bound on conductance Hit-and-Run, showing it strictly worse than or Ball Walk worst case.
منابع مشابه
Hit-and-run mixes fast
It is shown that the “hit-and-run” algorithm for sampling from a convex body K (introduced by R.L. Smith) mixes in time O(nR/r), where R and r are the radii of the inscribed and circumscribed balls of K. Thus after appropriate preprocessing, hit-andrun produces an approximately uniformly distributed sample point in time O(n), which matches the best known bound for other sampling algorithms. We ...
متن کاملDirection Choice for Accelerated Convergence in Hit-and-Run Sampling
Hit-and-Run algorithms are Monte Carlo procedures for generating points that are asymptotically distributed according to general absolutely continuous target distributions G over open bounded regions S. Applications include nonredundant constraint identification, global optimization, and Monte Carlo integration. These algorithms are reversible random walks which commonly apply uniformly distrib...
متن کاملCHRR: coordinate hit-and-run with rounding for uniform sampling of constraint-based models
Summary In constraint-based metabolic modelling, physical and biochemical constraints define a polyhedral convex set of feasible flux vectors. Uniform sampling of this set provides an unbiased characterization of the metabolic capabilities of a biochemical network. However, reliable uniform sampling of genome-scale biochemical networks is challenging due to their high dimensionality and inheren...
متن کاملHit - and - Run is Fast and Fun ∗
The hit-and-run algorithm is one of the fastest known methods to generate a random point in a high dimensional convex set. In this paper we study a natural extension of the hit-and-run algorithm to sampling from a logconcave distribution in n dimensions. After appropriate preprocessing, hit-and-run produces a point from approximately the right distribution in amortized time O∗(n3).
متن کاملCoordinate Selection Rules for Gibbs Sampling
This paper studies several di erent plans for selecting coordinates for updating via Gibbs sampling. It exploits the inherent features of the Gibbs sampling formulation, most notably its neighborhood structure, to characterize and compare the plans with regard to convergence to equilibrium and variance of the sample mean. Some of the plans rely on completely or almost completely random coordina...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Discrete and Computational Geometry
سال: 2023
ISSN: ['1432-0444', '0179-5376']
DOI: https://doi.org/10.1007/s00454-023-00497-x